Remarks on Bootstrap Percolation in Metric Networks 



T. Tlusty 

Physics of Complex Systems, Weizmann Institute of Science, Rehovot, (Israel) 

J. -P. Eckmann 

Departement de Physique Theorique et Section de Mathematiques, Universite de Geneve, (Switzerland) 

We examine bootstrap percolation in d-dimensional, directed metric graphs in the context 
of recent measurements of firing dynamics in 2D neuronal cultures. There are two regimes, 
depending on the graph size N. Large metric graphs are ignited by the occurrence of critical 
nuclei, which initially occupy an infinitesimal fraction, 0, of the graph and then ex- 

plode throughout a finite fraction. Smaller metric graphs are effectively random in the sense 
that their ignition requires the initial ignition of a finite, unlocalized fraction of the graph, 
> 0. The crossover between the two regimes is at a size A^* which scales exponentially 
with the connectivity range A like ~ exp A''. The neuronal cultures are finite metric 
graphs of size N ~ 10^ — 10^, which, for the parameters of the experiment, is effectively 
random since N <^ N^. This explains the seeming contradiction in the observed finite in 
these cultures. Finally, we discuss the dynamics of the firing front. 



A. Introduction 



Percolation in directed graphs deals with propagation of firing of nodes whereby each node 
which was "on" in turn ignites any node that can be reached by following the directed links. 
Bootstrap percolation (BP) generalizes conventional percolation by applying a stricter definition 



of ignition, a site only ignites when m > 1 sites pointing to it were ignited earlier ll , 



This generalization proved to be useful in many contexts (see 



lin and references therein). Here, 



we have in mind questions in connection with recent measurements of 2D neuronal cultures (NC) 



ll4tl6Ll8|, 



u. 



In these NC experiments, one grows a 2D culture of ~ 10^ — 10^ neurons. After the culture 
develops connections and forms a network, one externally ignites a variable number of neurons 
by varying a "firing threshold" in the culture, and observes how many neurons eventually will 
have fired. The experiments show that, as the fraction of initially (i.e., externally) excited neurons 
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exceeds a certain non-zero critical value, > 0, the activity of the network jumps abruptly to a 
basically complete ignition of the network within a very short time, while below this threshold, 
the firing essentially does not spread. 

Thus, the experiment exhibits a sharp transition in the number of excited neurons |^ when 
a certain initial firing threshold (fraction) is exceeded. A simple theoretical model was able to 
capture this phenomenon by describing the network in terms of a process very similar to BP in a 
random graph. There are some paradoxes in this result which the current paper will resolve: The 
random graph model lacks an important ingredient of actual neuronal networks in assuming that 
all pairs of neurons have equal probability to be connected. This is in contrast to the experimental 
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ity that the connection probability of close-by neurons is much higher than that of distant ones 

m. 

Taking these distances into account, we are in the realm of embedded networks, where the 
neurons have a fixed position in physical space and, as a consequence, the neural connections have 
a certain distance. This leads to an apparent paradox, because it is known — and will be discussed 
below — that in embedded graphs that have a metric, such as lattices, it is enough to externally 
excite an infinitesimal fraction of the neurons, /* 0, to activate a finite, non-zero fraction of the 
network. This would seem to contradict the experimental findings of [|6|] with their finite threshold. 
Or, asking differently: (i) Why does the random graph picture of [|6|] describe so successfully the 
measurements of a 2D NC although it completely neglects notions of space and vicinity? (ii) More 
generally, when can real-space networks be described as effectively random networks, and under 
which conditions does one have to take space into consideration? 

As we explain below, the puzzle is resolved because there is a basic difference in the manner 
in which random and metric graphs are ignited. In the latter, it suffices to initially turn on local- 
ized excitation nuclei, which are then able to spread an excitation front throughout the spatially 
extended network. In contrast, by their definition, there are no such nuclei in the random graphs, 
which lack the notion of locality, and one has to excite di finite fraction of the neurons to keep the 
ignition going. Still, as we shall show, the experimental network — which is obviously an example 
of a metric graph — is effectively random, since its finite size makes the occurrence of excitation 
nuclei very improbable (an answer to question (i)). More generally, we see that one can change 
the effective behavior of a network by changing its finite size N or by changing the finite range of 
connectivity A (question (ii)). For infinite graphs, what matters is the manner in which these two 
quantities approach infinity. The crossover between effectively random and metric behaviors is 
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determined by a size A^*, which explodes exponentially with the connectivity range, A^* ~ exp A*^, 
where d is the dimensionality. We also discuss the dynamics of the propagating firing cluster in 
effectively metric and random graphs. 



B. The basic setting 

We consider "neural networks", that is, directed graphs with "neurons", by which we mean 
nodes connected by directed links. We assume that any ordered pair i j of nodes can only be 
connected by one link. The connections are described by the adjacency matrix A, with Aij = 1 if 
there is a directed link from j to i, and Aij = otherwise. 

The neurons fire, and once they fire, in the model we consider here, they stay "on" forever. A 
neuron is supposed to be on at the beginning of time with some probability / and will be on at 
time t + 1 if at time t it was on, or if at least m of its upstream (incoming) nodes were on at time t 
(m may be termed "minimal influx"). This is described by the evolution equation 



Si{t + 1) = Si{t) + (1 



s^{t))9(^Ai,Sj-n?j , (1) 



where Si{t) describes the state of the neuron at time t: It is on if Sj(t) = 1 and off if Sj(t) = 0. 
Finally, 9 is the step function. 

This setting is practically equivalent to BP (which is also known as "A;-core percolation"). 
In a typical BP scenario, the nodes of a graph or lattice, usually undirected ones, are randomly 
populated and those nodes having less than k edges are "pruned" ll]. After iterative pruning 
there remains a connected "/c-core", which may vanish depending on the system parameters. It is 
straightforward to see that the analogue of pruning is the propagation of the firing cluster through- 
out the NC; the nodes that are pruned in each iteration of BP are equivalent to the newly excited 
neurons in each time step of the NC dynamics. In fact, if the network is (i-regular, then a NC with 
a minimal influx of m firing inputs can be mapped to a directed BP process with k = d — m. 
In the context of NC, one may term the dynamics of firing propagation "quorum percolation" 
since the ignition of a certain neuron requires a "quorum" of m firing inputs. It also hints for the 
potential uses of these models to describe the spread of diseases, rumors and opinions. 

Some facts are obvious from the definition of the model: The dynamics is monotonic, since a 
firing neuron can never turn off and therefore Sj (t + 1 ) > Si{t). Therefore, for any initial condition 
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s(0) = {sj(0)}^^ and any j one has that hnif^oo (t) = ^^(oo) exists. Furthermore, if is 
finite, then the system ([T]) converges to a steady state (in finite time). 

The dynamics is conveniently characterized by the initial firing concentration, / defined by 
/Ar(s, 0), where, for any t, 

N 

fN{s,t) = N-'J2s,it). 

It has been observed [6] that in directed random graphs, with fixed degree distribution, there is a 
value /* > (depending on this degree distribution) such that for large enough N and for 

/ivU,0) > /, 

there is "substantial firing", characterized by 

lim /7v(s, oo) > /7v(s,0) , 

for "many" random graphs and for "many" initial distributions s (in a suitable measure theoretic 
sense, for example with probability 1 with respect to the uniform measure). For m = 1 all this is 
in the realm of percolation theory. 



1. Random graphs 

The study of this problem for directed random graphs can be found in [^. Based on an en- 
semble average of ([U) it yields a self-consistency equation for the fraction $ = lim^^oo fNi'^t) of 
typically lit neurons at infinite time (in practice, when stationarity has been reached, no later than 

t = N): 

$ = / + (!- /)Prob (#firing inputs > m) = / + (1 - /)*(m,, $), (2) 

where the collectivity function \l/(m,p) accounts for the combinatorics of choosing at least m 
firing inputs of a randomly chosen node, when each node fires with a probability $. Assuming the 
probability for a node to be of in-degree k is pk, the combinatorial expression for ^ is 

(3) 



h — m f—im ^ ' I — ■ I — I I — ■ 



k=m £=m 

For similar treatments of undirected lattice and random graphs see |12L 15|, |7I]- When the average 
in-degree k = kpk and the minimal influx m are large, k.m':^ 1, one can neglect the variance 
in the number of firing inputs and the number of firing inputs into a node of degree A; is ~ 
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As a result, \l/(m, $) can b e ap proximated by its mean-field expression \l/(m, $) ~ Prob > 
m) ^ j^rn/<i>'P^' lll^- '^^^^ ^ regular graph, with in-degree A; = A; at all nodes, 

Pk = 5fe,fc' one finds \&(m, $) ~ — m/k). 

Equation (l2l) can be rewritten as a function from $ to /, / = F(m, $) = ($ — \E')/(1 — 
or, using the inverse function, as $(m, /) = F~^(m, /). The solution of the latter equation 
jumps from $ ~ / to $ ~ 1 when = {i.e., is multi-valued), or equivalently when 
= (1 — ^|$J/(1 — It follows from the definition of ^ that there exists such critical 

and = F(m, > 0. In the simple case of the regular graph, neglecting fluctuations in 
the mean field approximation implies that every node has exactly firing inputs and, as a result, 

~ m/k. This mean field result approximates f^, well when the in-degree has a large average k 
and relatively small variance. 



2. Metric graphs 

Our aim here is to consider not only connectivity but also metric, mimicking in a poor man's 
way the idea that neurons have axons of finite length and are located at some position in R"^ (with 
d = 2 or d = 3, depending on the experiment). 

Things change rather drastically, when the notion of metric and proximity is added to the game, 
for example by putting the neurons on a lattice. In this case, we can show that = no matter 
what m is as long as the coordination number in the lattice exceeds m. 

A simple example is the triangular lattice of Fig. [T] where, for each node, the 3 edges pointing 
to the North, East and NE are outputs and the 3 edges coming from S, SW and W are inputs. 
For m = 2, it suffices that somewhere in the lattice two neighboring nodes fire to ignite a finite 
fraction of the lattice {i.e., /* = 0). First, a diagonal stripe propagates through the lattice. When 
this diagonal meets a firing node at a neighboring diagonal it "activates" this diagonal which is 
now included in the propagating stripe. Eventually, the stripe thickens and might cover the whole 



lattice yj] 



Note that what really matters here is the appearance of a firing nucleus. Namely, if somewhere 
in the graph 2 neighbors are lit up at time 0, then a sizeable part (or all) of the graph will bum. 
Similarly, when m inputs are needed, a nucleus of size (proportional to) m will suffice to ignite a 
large burning within the graph. 

Our focus is on the transition between the two BP scenarios we have described so far: The 



FIG. 1: A simple example of a directed graph with k = 3 and m = 2, where 2 initially ignited sites generate 
an infinity of ignited sites along a diagonal strip. The times of ignition are indicated by the numbers next to 
the circle. Also note that the ignited strip gets thicker (from 2 to 3 diagonals) when the site numbered 5 is 
close to another site which was initially ignited. 

random non-metric graph and a graph which is embedded in a metric space. Apparently, the 
question in the metric graph is that of the probability of a nucleus being lit up at time 0. In the next 
section, we propose a model which comes relatively close to the experimental setup as described 



Consider the following model of a spatial network: A large number N of nodes are distributed 
randomly in R'^ with a number density n = N/V. In other words, there are, on average, n nodes 
per unit volume. We now give ourselves a "vicinity function" g : R+ R+, with the property: 



A directed edge connects any two nodes with a probability (correlation) g{r) that depends on the 
distance r = \xi — Xj\. Typical examples of functions g are (normalized versions of) g{r) ~ 




C. Networks in space 




(4) 
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exp(— r/A), g{r) ~ exp(— {r/Xf) or a scale-free type g{r) ~ r~". For the scale-free graph we 
define an effective length scale Ae as the radius of the sphere drawn around a node that contains 
"most" of the nodes that are connected to central one, e.g., 99% of them. 

1. Infinite graphs 

There is an essential difference between finite, but large, graphs and infinite graphs. We first 
deal with the infinite graph. Since the graph is infinite, one can keep / arbitrarily close to 0, and 
still have, somewhere in this infinite graph, any desired firing nucleus. Of course, the probability 
to find, in any finite region, a big nucleus is exponentially small in the number of nodes which are 
supposed to be lit up in a cluster at time 0. 

Still, in infinite volume, and for any / > 0, we can assume that there is a nucleus much bigger 
than the scale A of g{r), resp. much bigger than Ag when g is like a power law, and that inside of 
this nucleus the firing fraction at time is a certain /locai (which one can choose as close to 1 as 
one wishes). 

Consider now a non-lit node which is close to the boundary of such a nucleus (and assume for 
simplicity that the nucleus contains a large sphere of lit nodes). There will also be some "hair" 
lit up, but we neglect this, since it only will make propagation stronger. On average, half (if the 
sphere is big enough) of the inputs of the given node come from the sphere. It follows that to 
fire this node it is enough to have /iocai^/2 > m (and one can take any /locai, e.g., 1 since we are 
considering an infinite graph). As a consequence, the firing sphere will explode throughout a large 
part of the graph. 

There are some corrections to this simple mean-field condition, which take into account the 
combinatorics of choosing the m (or more) firing inputs from the sphere. However, these correc- 
tions are negligible if A;, m ^ 1. The corrections amount to solving ^ with fceff = k/2 and /locai- 
In summary, to fire a spatial network all that is needed is a large enough nucleus (> A), which will 
be found in an infinite graph (but not in experimentally available NC graphs) even at infinitesimal 

/• 

Thus, we have the following dichotomy: either A is finite and then /* = as we argued above, 
or at A ^ oo we return to the random graph with its finite > because then any two nodes 
are connected with the same probability. The argument above applies also to a scale-free network 
when A is replaced by the effective scale Ag. 
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2. Finite graphs and comparison with experimental data 

The ignition of a metric graph requires the appearance of a large enough nucleus. It is therefore 
reasonable to define, in a statistical manner, that a graph is ignited when the probability to find at 
least one such nucleus, prmc, becomes non-negligible (say 50%). Ignition occurs when the initial 
firing, /, exceeds a critical value In metric graphs, as we show below, the ignition point is a 
function of the graph size N, the connectivity range A, the average in-degree k and the minimal 
influx, m. In the following, we heuristically estimate /*(A^, A, k, m). We show that there is a graph 
size, N^, where the graph crosses over from an effectively random regime, /* ^ /^^" > (the 
superscript "ran" denotes the value for a random graph), to the effectively metric regime, /* 0. 

We consider a metric graph of nodes and density n = N/V. The nodes connect according to 
a vicinity function g with a scale A. At t = a randomly chosen fraction / of the nodes is ignited. 
For our purposes, we can assume that the critical nucleus is approximately a sphere of radius A, 
containing Nx ~ nX'^ nodes. 

To ignite the graph, the local initial firing fraction /locai inside the nucleus must exceed fl^^ ~ 
m/k of the corresponding random graph. We therefore look for the circumstances when it is likely 
to find at least one such lit nucleus. Typically, A^a ^ 1 so that the number Lx of lit nodes inside 
the sphere distributes normally with mean fNx and variance cr^ = /(I — f)Nx. The probability 
sx that the sphere of radius A becomes critical is therefore 

{Lx - fN 



Sx = Pt{Lx > frNx) = ^= r dLx exp 

ay Ztx J /ran 



2a2 



(5) 



where 

f^Nx - fNx fr - / 



■■Nx^''' (6) 



is the normalized deviation of the required number of lit nodes fl^^Nx from its mean fNx- To 
obtain the ~ in ([5]) we have simply replaced the integral by its lower boundary value (which is a 
good approximation for the large z we consider). 

The nucleation probability p^uc becomes relevant when the expected number of nuclei, Nsx, 
exceeds one. This defines a crossover condition, sx — N~'^, which, by inverting ([5]), leads, for 
large A^, to 

^ (21ogiV)^/^ (7) 
This relation determines the fraction required to ignite a graph of size A^, vicinity scale A and 
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FIG. 2: The minimal firing fraction /* is plotted as a function of the parameter ^ = log N/Nx. The solid 
line is the solution of dU), = (2^ + 1)^^ (^/f ° + ^ - + 2fl^'^{l - fl^""))^ , whereas the dashed 

lines are the asymptotic solutions in the metric regime ©, and - /* ~ S}/'^ in the random 

regime ( flOl ). 



when requiring a value f™^ for a random graph with the same connectivity (/. e. , degree distribution 
Pk) but no particular metric properties (Fig. We find from (l6l|7]) that the fraction at the 
ignition transition is given by 

^J^^N. ^ 2^0, N. (8) 

Solving dH]) for one finds that if is very small which is the case for metric graphs, then to 
ignite this metric graph of size N one would need to externally ignite a fraction 



Indeed, this fraction vanishes for infinite graphs, but only logarithmically. 

At the other extreme, of effectively random graphs, is somewhat larger, from ([8]) we obtain 



/* = fr - [2/r(i - frr ( ^ ) • (lo) 
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In this case, as announced earlier, increases with A^^ ~ nX'^ and decreases logarithmically with 
the size of the network, A^. A reasonable definition of the crossover between effectively random 
and effectively metric graphs is the size N^. at which the required /=„ is significantly reduced relative 
to the random graph value, /^^°, say = afl^'^ with, e.g., a = 1/2 (Fig. O. From ([8]), we find 
that this occurs at 

1 - a)2/r 



A^* ~ exp 



£ra.n 



.2«(1 - afl 

It is clear from the discussion that the relevant dimensionless parameter in the system is ^ = 
log N/ Nx ~ log N/ A*^. The random graph regime is ^ ^ 1 whereas graphs are effectively metric 
in the regime ,^ ^ 1. The critical fraction changes its scaling from fl^^ — /* ~ ^^^^ in the 
random graph regime to f* ~ f ~^ in the metric regime. 

nn n n 

In the NC experiment [|4|, la |8|, USD, the 2D density of the neurons ranges between n = 
150 — 1,000 neurons/mm^ and their average connectivity is I; = 60 — 150 inputs/neuron. The 
connectivity scale is approximately A = 1 — 2 mm lll3ll and the minimal nucleus size is therefore 
about A^A = vrriA^ = 500 — 10, 000 neurons. The minimal influx in these experiments is m ~ 15 
before a drug that weakens the synapses is added, which increases the minimal inputs to m ~ 80. 
These values correspond to minimal ignition fractions of fl^^ = 0.1 — 0.25 for the drug free NC 
and fl^^^ = 0.5 — 1 after the drug was added. 

By substitution of the experimental values in the formula for A^^ (fTTI) . we find that the range 
of crossover size for drug free NC is A^* = 3 ■ 10^ — 10'^°°. Note that the lower regime is ob- 
tained for the extremal conditions of a very dilute culture n = 150 with low connectivity range, 
A = 1 mm, which is also highly connected, k = 150. In fact, this combination of parameters is 
not feasible, since dilute networks tend to be less connected, and the crossover range A^* is well 
above the experimental size of A^ ~ 10^ — 10^ neurons. When drug is added, A^* explodes to 
A^* ~ 10^° — 10^°°°. These ridiculously large numbers - the number of atoms in the universe is 
somewhere around 10^° whereas the number of neurons in the human brain is ~ 10^^- imply that 
the NC can safely be regarded as a random graph despite the fact that it is actually a metric graph 
embedded in space. In other words, it is highly improbable to find an igniting nucleus and the NC 
ignites "homogeneously" at /^^°. Therefore, geometry does not seem to come into play in those 
experiments, only topology. 

Interestingly, the situation in physical models of BP is quite the opposite. In typical situations, 
one would have A ~ 1 — 2 lattice constants or A'^a ~ 3 — 10 (for example, in the triangular 
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lattice from Fig. [B -?Va = 3). This implies moderate crossover size A^* ~ 10 — 10^. Thus, 
unlike NC experiments, even relatively small graphs, of size easily accessible to experiments and 
simulations, are well within the metric regime, where /* ^ (see e.g., yj]). It also renders NC as 
a rare example for naturally occurring, large (effectively) random graphs. 

D. Another mechanism for transition in infinite graphs 

As we said, as long as the graph is infinite, there is a trivial phase transition in either the 
graph has some scale, A < oo, and /* = 0, or it does not and > 0. The transition between these 
two behaviors appears at A = oo. As a side remark we note that one can shift the transition to a 
finite A by the following procedure: Divide the edges into two sub-populations: one that spreads 
uniformly without any distance dependence and one that forms according to g{r). The probability 
that an edge connects i and j is then g{\ri — rj\)+koo/N, where koo <kis the number of "random" 
edges per node. This mechanism enables a smoother transition. For any fl^^, there is a transition 
connectivity, A;^ given by 1 — k^/k = f^,, where the system changes its behavior. When k^o > k'^ 
no nucleus is enough because it is now impossible to surpass fl^^ locally and the graph needs to 
compensate by a uniform = (k^o — k'^)/k > 0. The parameter k^o may be varied by varying 
the connectivity range, A. 

E. Dynamics 

Having dealt with the total number of lit nodes at "infinite" time, we next discuss the dynam- 
ics of how this state is reached. One may think of a dynamical system for the space-dependent 
ensemble average $(r, t) = {si{t)) in the vicinity of r. 

The average is for example over a ball of radius A: 

Z— 'j:|rj— r|<A 

If $(r, t) is smooth enough we can write a dynamical equation 

*(M.l)^*(M).(l-*(M))«(./d.'«(|.'-W. «)-»). (12) 
where g is the vicinity function with its scale A as before. 
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The time continuous version is simply 

^?M = (l-<l>(r,t))^(^n I dr"5(|r"|)$(r + r",t)-m^, (13) 

with the change of variables r" = r' — r. If $(r, t) is smooth over a scale ~ A, then we can 
approximate 

$(r', t) ~ <l>(r, t) + r" ■ V$(r, t) + ^r" ■ V^$( r, t) ■ r" 

One finally gets 

= (1 - <l>(r, t)) e (^$(r, t) + rlV'^r, t) - m) , (14) 

where Tq = ^ J dx |x|^ ^dxl). This intuitive result basically says that $(r, t) increases at a rate 
that is a product of the probability that r was not already ignited and a very steep function of 
the average number of firing neurons in its vicinity. This averaging is performed by taking the 
Laplacian. The dynamics will tend to smooth firing fronts, since concave regions of a firing front 
have more firing neurons around them and will propagate faster than convex regions of the front. 

We will restrict our discussion to the case of the effectively random graph, where the firing 
fraction <l>(t) is homogeneous in space. The mean-field equation in this case is 

In other words, below m/k, d^/dt = and the graph will never ignite, and above this value 
d^/dt ^ 1, which means that the graph fires within a few time steps with the trivial exponential 
saturation (and that the continuous time approximation is probably not very good, since the time 
scale is one step). 

It is interesting to look more closely at the collectivity function \E'(m, $) of ([3]), which was 
approximated in (fT5l) by the step-function. If A; ^ 1, one can approximate the binomial distribution 
in ([3]) by anormalone, A^(/c$, cr), with amean /;;$ and a variance cr^ = k^(l — ^). The summation 
is replaced by integration, 

E C^ (1 - = ^rdi exp[-(£ - k^r/2a^] . 



When all nodes have in-degree about k, that is, pk ^ the collectivity function is approximated 
as in ^ by the value of the integral at the boundary and we get 
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The dynamics is then 



(1 - <l>)M/(m, $) = i(l - $)^^exp(-iu;2) _ (^^^ 



Taking into account in (1161) fluctuations in the number of firing inputs around the average value 
of A;$ allows the possibility that a random graph will eventually ignite even if the initial firing 
fraction / = $(t = 0), is much smaller than = m/k. Of course, this ignition is a rather slow 
process. In this regime, the dynamics (fT6l) is approximately 



f-(S)"'-H-"V(2«)). 

Neglecting the square root and integrating, we find that the contribution is dominated by the initial 
value. Thus, $ is approximately 

my(2k) 



\og{U - t) ' 

with t^: ~ exp [m? / {2kf)) . Note that t^, is the "ignition time", i.e., the time to ignite a given 
fraction of the graph, and it diverges exponentially as / ^ 0. 

If pk is not sharp then one can utilize the mean-field approximation and get ^(m, $) = 
(ikpk6{k — m/$) = dkp^, which is simple to calculate for certain distributions. For 
example, if pk distributes exponentially, pk ~ exp(— A;/A;), then for small $ <^ fl^^ = m/k the 
dynamics is approximately (i<l>/(it ~ \E' ~ exp(— m/ The asymptotic growth is again loga- 
rithmic ~ [m/k)/ log(t* — t), with a somewhat different ignition time ~ exp [m/ (kf)) . 

The asymptotic growth is quite different for scale-free in-degree distributions, pk ~ {k/ko)~"', 
where k^ is a lower cut-off and 7 > 1. In this case, the dynamics far from is d^/dt ~ 
{kQ^/m)^~^. Integrating, one finds that, with initial condition $(0) = /, the growth in this case 
is a power law, 

$(t)~(/2~^-sgn(7-2).t/r)^/(^-^) , 

with the positive constant r = (m/ko)'^"^ /\^ — 2\. The ignition time t* can be defined by = 
which yields 

= sgn(7 - 2) ■ rif-^ - . 

If 1 < 7 < 2, this leads to 

U^Tf,^~\ and ~ (/2-^ + t/r)i/(2-^) . 
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For 7 > 2 the growth is slower and we get 

U ~ r/p-^ , and ^t) ~ (1//^"' - t/r)-^/^^-^) . 
In this case, the ignition time diverges as / ^ 0. In the marginal case, 7 = 2, we finally find 

~ (m/ko) log(/*//) , and ~ exp (mt/ko) . 

n 

It is interesting to note that exponential growth was observed in experiments (9], which also 
suggested that the degree distribution is a power law. However, it is not clear whether the sim- 
ple model presented here can describe the dynamics and whether the exponential growth is indeed 
related to a scale-free degree distribution. It is evident from the last three examples that the asymp- 
totic growth below is determined by the tail of the in-degree distribution. Fat tail distributions 
lead to faster growth of the firing region because they have a non-negligible fraction of "hubs" 
with many input edges. 
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